2,339 research outputs found

    Localizing Active Objects from Egocentric Vision with Symbolic World Knowledge

    Full text link
    The ability to actively ground task instructions from an egocentric view is crucial for AI agents to accomplish tasks or assist humans virtually. One important step towards this goal is to localize and track key active objects that undergo major state change as a consequence of human actions/interactions to the environment without being told exactly what/where to ground (e.g., localizing and tracking the `sponge` in video from the instruction "Dip the `sponge` into the bucket."). While existing works approach this problem from a pure vision perspective, we investigate to which extent the textual modality (i.e., task instructions) and their interaction with visual modality can be beneficial. Specifically, we propose to improve phrase grounding models' ability on localizing the active objects by: (1) learning the role of `objects undergoing change` and extracting them accurately from the instructions, (2) leveraging pre- and post-conditions of the objects during actions, and (3) recognizing the objects more robustly with descriptional knowledge. We leverage large language models (LLMs) to extract the aforementioned action-object knowledge, and design a per-object aggregation masking technique to effectively perform joint inference on object phrases and symbolic knowledge. We evaluate our framework on Ego4D and Epic-Kitchens datasets. Extensive experiments demonstrate the effectiveness of our proposed framework, which leads to>54% improvements in all standard metrics on the TREK-150-OPE-Det localization + tracking task, >7% improvements in all standard metrics on the TREK-150-OPE tracking task, and >3% improvements in average precision (AP) on the Ego4D SCOD task.Comment: In Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing (EMNLP

    Blind Source Separation of Hemodynamics from Magnetic Resonance Perfusion Brain Images Using Independent Factor Analysis

    Get PDF
    Perfusion magnetic resonance brain imaging induces temporal signal changes on brain tissues, manifesting distinct blood-supply patterns for the profound analysis of cerebral hemodynamics. We employed independent factor analysis to blindly separate such dynamic images into different maps, that is, artery, gray matter, white matter, vein and sinus, and choroid plexus, in conjunction with corresponding signal-time curves. The averaged signal-time curve on the segmented arterial area was further used to calculate the relative cerebral blood volume (rCBV), relative cerebral blood flow (rCBF), and mean transit time (MTT). The averaged ratios for rCBV, rCBF, and MTT between gray and white matters for normal subjects were congruent with those in the literature

    On the Analysis of Product Appropriateness Principles

    Get PDF
    The purpose of this study is to explore appropriateness of the various products presented in the market and the application of appropriateness principles to the product design. To obtain appropriateness principles, this study compares and analyzes a variety of products available in the market. After obtaining preliminary principles, many times convergence and analysis are operated for getting more accurate principles. Then, AHP method is used for evaluating importance of every appropriateness principles and appropriateness principles are obtained. And, the appropriateness principles are used to construct the design process of appropriateness product. Finally, some design cases are operated and appropriateness principles are evaluated for the products of design cases. The results of this study are obtained 10 appropriateness principles: freedom, demand, environmental protection, effectiveness, intuition, compliance, simplicity, optimal performance, simplicity, fault tolerance. And, weights of appropriateness principles get in this paper

    ANALYSIS OF GRIP FORCE DURING GOLF PUTTING AT DIFFERENT DISTANCES - PILOT STUDY

    Get PDF
    The purpose of this study was to explore the grip force performance at different distances during putting stroke. Four golfers (2 professionals and 2 novices) as accurately as possible executed a putt to reach 1, 2 and 3 m target distance, respectively. Putting motions were recorded by JVC video and grip pressure measurement sensor placed on two hands, allowing the force output of all regions of the hands to be measured. The grip force trace among 1 to 3 m distance was repeatable across putting strokes for each golfer but between golfers was inconsistent. Dominant forces appear to arise primarily from the left hand. In this study, the grip force and force distribution were preliminarily discovered during putting stroke at different distances. This research has suggested a potentially important influence of grip force on the golf putting performance in long distance

    Effect of Influenza Vaccination on Mortality and Risk of Hospitalization in Elderly Individuals with and without Disabilities: A Nationwide, Population-Based Cohort Study

    Get PDF
    Purpose: The effects of influenza vaccines are unclear for elderly individuals with disabilities. We use a population-based cohort study to estimate the effects of influenza vaccines in elderly individuals with and without disabilities. Methods: Data were taken from the National Health Insurance Research Database and Disabled Population Profile of Taiwan. A total of 2,741,403 adults aged 65 or older were identified and 394,490 were people with a disability. These two groups were further divided into those who had or had not received an influenza vaccine. Generalized estimating equations (GEE) were used to compare the relative risks (RRs) of death and hospitalization across the four groups. Results: 30.78% elderly individuals without a disability and 34.59% elderly individuals with a disability had vaccinated for influenza. Compared to the unvaccinated elderly without a disability, the vaccinated elderly without a disability had significantly lower risks in all-cause mortality (RR = 0.64) and hospitalization for any of the influenza-related diseases (RR = 0.91). Both the unvaccinated and vaccinated elderly with a disability had significantly higher risks in all-cause mortality (RR = 1.81 and 1.18, respectively) and hospitalization for any of the influenza-related diseases (RR = 1.73 and 1.59, respectively). Conclusions: The elderly with a disability had higher risks in mortality and hospitalization than those without a disability; however, receiving influenza vaccinations could still generate more protection to the disabled elderl
    corecore